Looking for change? Roll the Dice and demand Attention

Change detection, i.e. identification per pixel of changes for some classes of interest from a set of bi-temporal co-registered images, is a fundamental task in the field of remote sensing. It remains challenging due to unrelated forms of change that appear at different times in input images. Here, we propose a reliable deep learning framework for the task of semantic change detection in very high-resolution aerial images. Our framework consists of a new loss function, new attention modules, new feature extraction building blocks, and a new backbone architecture that is tailored for the task of semantic change detection. Specifically, we define a new form of set similarity, that is based on an iterative evaluation of a variant of the Dice coefficient. We use this similarity metric to define a new loss function as well as a new spatial and channel convolution Attention layer (the FracTAL). The new attention layer, designed specifically for vision tasks, is memory efficient, thus suitable for use in all levels of deep convolutional networks. Based on these, we introduce two new efficient self-contained feature extraction convolution units. We validate the performance of these feature extraction building blocks on the CIFAR10 reference data and compare the results with standard ResNet modules. Further, we introduce a new encoder/decoder scheme, a network macro-topology, that is tailored for the task of change detection. Our network moves away from any notion of subtraction of feature layers for identifying change. We validate our approach by showing excellent performance and achieving state of the art score (F1 and Intersection over Union-hereafter IoU) on two building change detection datasets, namely, the LEVIRCD (F1: 0.918, IoU: 0.848) and the WHU (F1: 0.938, IoU: 0.882) datasets.Comment: 28 pages, under review in ISPRS P&RS, 1st revision. Figures of low quality due to compression for arxiv. Reduced abstract in arxiv due to character limitation

Cropland Mapping over Sahelian and Sudanian Agrosystems: A Knowledge-Based Approach Using PROBA-V Time Series at 100-m

Early warning systems for food security require accurate and up-to-date information on the location of major crops in order to prevent hazards. A recent systematic analysis of existing cropland maps identified priority areas for cropland mapping and highlighted a major need for the Sahelian and Sudanian agrosystems. This paper proposes a knowledge-based approach to map cropland in the Sahelian and Sudanian agrosystems that benefits from the 100-m spatial resolution of the recent PROBA-V sensor. The methodology uses five temporal features characterizing crop development throughout the vegetative season to optimize cropland discrimination. A feature importance analysis validates the efficiency of using a diversity of temporal features. The fully-automated method offers the first cropland map at 100-m using the PROBA-V sensor with an overall accuracy of 84% and an F-score for the cropland class of 74%. The improvements observed compared to existing cropland products are related to the hectometric resolution, to the methodology and to the quality of the labeling layer from which reliable training samples were automatically extracted. Classification errors are mainly explained by data availability and landscape fragmentation. Further improvements are expected with the upcoming enhanced cloud screening of the PROBA-V sensor

AI4Boundaries: an open AI-ready dataset to map field boundaries with Sentinel-2 and aerial photography

Field boundaries are at the core of many agricultural applications and are a key enabler for the operational monitoring of agricultural production to support food security. Recent scientific progress in deep learning methods has highlighted the capacity to extract field boundaries from satellite and aerial images with a clear improvement from object-based image analysis (e.g. multiresolution segmentation) or conventional filters (e.g. Sobel filters). However, these methods need labels to be trained on. So far, no standard data set exists to easily and robustly benchmark models and progress the state of the art. The absence of such benchmark data further impedes proper comparison against existing methods. Besides, there is no consensus on which evaluation metrics should be reported (both at the pixel and field levels). As a result, it is currently impossible to compare and benchmark new and existing methods. To fill these gaps, we introduce AI4Boundaries, a data set of images and labels readily usable to train and compare models on field boundary detection. AI4Boundaries includes two specific data sets: (i) a 10 m Sentinel-2 monthly composites for large-scale analyses in retrospect and (ii) a 1 m orthophoto data set for regional-scale analyses, such as the automatic extraction of Geospatial Aid Application (GSAA). All labels have been sourced from GSAA data that have been made openly available (Austria, Catalonia, France, Luxembourg, the Netherlands, Slovenia, and Sweden) for 2019, representing 14.8 M parcels covering 376 K km2. Data were selected following a stratified random sampling drawn based on two landscape fragmentation metrics, the perimeter/area ratio and the area covered by parcels, thus considering the diversity of the agricultural landscapes. The resulting “AI4Boundaries” dataset consists of 7831 samples of 256 by 256 pixels for the 10 m Sentinel-2 dataset and of 512 by 512 pixels for the 1 m aerial orthophoto. Both datasets are provided with the corresponding vector ground-truth parcel delineation (2.5 M parcels covering 47 105 km2), and with a raster version already pre-processed and ready to use. Besides providing this open dataset to foster computer vision developments of parcel delineation methods, we discuss the perspectives and limitations of the dataset for various types of applications in the agriculture domain and consider possible further improvements. The data are available on the JRC Open Data Catalogue: http://data.europa.eu/89h/0e79ce5d-e4c8-4721-8773-59a4acf2c9c9 (European Commission, Joint Research Centre, 2022).</p

The academic, economic and societal impacts of Open Access: an evidence-based review

Ongoing debates surrounding Open Access to the scholarly literature are multifaceted and complicated by disparate and often polarised viewpoints from engaged stakeholders. At the current stage, Open Access has become such a global issue that it is critical for all involved in scholarly publishing, including policymakers, publishers, research funders, governments, learned societies, librarians, and academic communities, to be well-informed on the history, benefits, and pitfalls of Open Access. In spite of this, there is a general lack of consensus regarding the potential pros and cons of Open Access at multiple levels. This review aims to be a resource for current knowledge on the impacts of Open Access by synthesizing important research in three major areas: academic, economic and societal. While there is clearly much scope for additional research, several key trends are identified, including a broad citation advantage for researchers who publish openly, as well as additional benefits to the non-academic dissemination of their work. The economic impact of Open Access is less well-understood, although it is clear that access to the research literature is key for innovative enterprises, and a range of governmental and non-governmental services. Furthermore, Open Access has the potential to save both publishers and research funders considerable amounts of financial resources, and can provide some economic benefits to traditionally subscription-based journals. The societal impact of Open Access is strong, in particular for advancing citizen science initiatives, and leveling the playing field for researchers in developing countries. Open Access supersedes all potential alternative modes of access to the scholarly literature through enabling unrestricted re-use, and long-term stability independent of financial constraints of traditional publishers that impede knowledge sharing. However, Open Access has the potential to become unsustainable for research communities if high-cost options are allowed to continue to prevail in a widely unregulated scholarly publishing market. Open Access remains only one of the multiple challenges that the scholarly publishing system is currently facing. Yet, it provides one foundation for increasing engagement with researchers regarding ethical standards of publishing and the broader implications of 'Open Research'

Towards a set of agrosystem-specific cropland mapping methods to address the global cropland diversity

Accurate cropland information is of paramount importance for crop monitoring. This study compares five existing cropland mapping methodologies over five contrasting Joint Experiment for Crop Assessment and Monitoring (JECAM) sites of medium to large average field size using the time series of 7-day 250 m Moderate Resolution Imaging Spectroradiometer (MODIS) mean composites (red and near-infrared channels). Different strategies were devised to assess the accuracy of the classification methods: confusion matrices and derived accuracy indicators with and without equalizing class proportions, assessing the pairwise difference error rates and accounting for the spatial resolution bias. The robustness of the accuracy with respect to a reduction of the quantity of calibration data available was also assessed by a bootstrap approach in which the amount of training data was systematically reduced. Methods reached overall accuracies ranging from 85% to 95%, which demonstrates the ability of 250 m imagery to resolve fields down to 20 ha. Despite significantly different error rates, the site effect was found to persistently dominate the method effect. This was confirmed even after removing the share of the classification due to the spatial resolution of the satellite data (from 10% to 30%). This underlines the effect of other agrosystems characteristics such as cloudiness, crop diversity, and calendar on the ability to perform accurately. All methods have potential for large area cropland mapping as they provided accurate results with 20% of the calibration data, e.g. 2% of the study area in Ukraine. To better address the global cropland diversity, results advocate movement towards a set of cropland classification methods that could be applied regionally according to their respective performance in specific landscapes.Instituto de Clima y AguaFil: Waldner, François. Université catholique de Louvain. Earth and Life Institute - Environment, Croix du Sud; BelgicaFil: De Abelleyra, Diego. Instituto Nacional de Tecnología Agropecuaria (INTA). Instituto de Clima y Agua; ArgentinaFil: Veron, Santiago Ramón. Instituto Nacional de Tecnología Agropecuaria (INTA). Instituto de Clima y Agua; Argentina. Universidad de Buenos Aires. Facultad de Agronomía. Departamento de Métodos Cuantitativos y Sistemas de Información; ArgentinaFil: Zhang, Miao. Chinese Academy of Science. Institute of Remote Sensing and Digital Earth; ChinaFil: Wu, Bingfang. Chinese Academy of Science. Institute of Remote Sensing and Digital Earth; ChinaFil: Plotnikov, Dmitry. Russian Academy of Sciences. Space Research Institute. Terrestrial Ecosystems Monitoring Laboratory; RusiaFil: Bartalev, Sergey. Russian Academy of Sciences. Space Research Institute. Terrestrial Ecosystems Monitoring Laboratory; RusiaFil: Lavreniuk, Mykola. Space Research Institute NAS and SSA. Department of Space Information Technologies; UcraniaFil: Skakun, Sergii. Space Research Institute NAS and SSA. Department of Space Information Technologies; Ucrania. University of Maryland. Department of Geographical Sciences; Estados UnidosFil: Kussul, Nataliia. Space Research Institute NAS and SSA. Department of Space Information Technologies; UcraniaFil: Le Maire, Guerric. UMR Eco&Sols, CIRAD; Francia. Empresa Brasileira de Pesquisa Agropecuária. Meio Ambiante; BrasilFil: Dupuy, Stéphane. Centre de Coopération Internationale en Recherche Agronomique pour le Développement. Territoires, Environnement, Télédétection et Information Spatiale; FranciaFil: Jarvis, Ian. Agriculture and Agri-Food Canada. Science and Technology Branch. Agri-Climate, Geomatics and Earth Observation; CanadáFil: Defourny, Pierre. Université Catholique de Louvain. Earth and Life Institute - Environment, Croix du Sud; Belgic

A comparison of global agricultural monitoring systems and current gaps

Global and regional scale agricultural monitoring systems aim to provide up-to-date information regarding food production to different actors and decision makers in support of global and national food security. To help reduce price volatility of the kind experienced between 2007 and 2011, a global system of agricultural monitoring systems is needed to ensure the coordinated flow of information in a timely manner for early warning purposes. A number of systems now exist that fill this role. This paper provides an overview of the eight main global and regional scale agricultural monitoring systems currently in operation and compares them based on the input data and models used, the outputs produced and other characteristics such as the role of the analyst, their interaction with other systems and the geographical scale at which they operate. Despite improvements in access to high resolution satellite imagery over the last decade and the use of numerous remote-sensing based products by the different systems, there are still fundamental gaps. Based on a questionnaire, discussions with the system experts and the literature, we present the main gaps in the data and in the methods. Finally, we propose some recommendations for addressing these gaps through ongoing improvements in remote sensing, harnessing new and innovative data streams and the continued sharing of more and more data